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1. BEHAVIOURAL SCIENTISTS' PERCEPTION AND DEFINITION OF RE 
SEARCH PROBLEMS: SOME RESULTS AND CONCLUSIONS 



This report presents our method for the analysis of concepts by data processing 
(ANACONDA). The method has been developed in connection with an empirical 
investigation of the way in which researchers perceive , structure and define 
problems suitable for behavioural science research. The research has been fi- 
nanced by the Swedish Board of Education. 

ANACONDA is an attempt to develop a method for the analysis of content that 
is scientifically more satisfactory than classical content analysis methods. ANA- 
CONDA has been applied to statements made by researchers on scientific docu- 
mentation and information. A few examples of results from this study will be 
given. Following Miller, Galanter & Pribram's (I960) "Plans and the structure 
of behavior", we can say that the researcher's plan for solving his information 
problem contains intentions and goal notions, plus an idea of which means can be 
used to achieve goals, i. e. means-goal hierarchies. The intention is to get in 
principle two types of information (1) for demarcation of concepts and (2) about 
research methods. 

When the intention is to get information for the demarcation of concepts the 
strategy (means) used is problem discussion (discussion seminars, project meet- 
ings, informal literature seminars). On the other hand, when the intention is to 
find information concerning research methods the strategy developed is to a cev 
tain extent bibliographic information -seeking and visits to international symposia. 
But primarily tutors and fellow-researchers are asked. The conclusion we can 
draw is that researchers do not use the same strategies for getting information 
about demarcation of concepts and information on research methods respectively. 
Furthermore since both types of information are negatively related to each other, 
we can conclude that the information -seeking strategy used is a function of the 
type of information sought. 

In strumentalization , i.e. the technical systems available for channelling in- 
formation, is used to a certain extent to obtain bibliographic references, i. e. in- 
formation about information. But the actions that form the building stones of the 
researchers' information -seeking strategies express a neutral to negative atti- 
tude. 

One condition ANACONDA must fulfil is that the method must lead to a valid 
reconstruction of the cognitive structures which we assume underlie verbal ex- 
pressions. An attempt to demonstrate the validity of the method is made in the 
last Chapter. 

Considering the scientific debate of recent years on process research and the 
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marked limitations of various assessment schedules as data -gathering methods, 
a continuous development of ANACONDA should represent a significant contribu- 
tion to the research methods that are available to behavioural scientists. 

The purpose of this introductory presentation of research results achieved 
by applying ANACONDA to behavioural scientists' verbal statements concerning 
scientific information and documentation is (1) to motivate the reader to expend 
some energy in following through this exposition and (2) to offer some pointers 
to the theoretical framework behind the development of a method for studying 
complex psychological phenomena, such as communication by means of symbols. 



_ 4 - 



2. FORMULATION OF RESEARCH PROBLEMS: DEVELOPMENT OF A MODEL 
FOR INVESTIGATION 

Psychological research has investigated how we optimally may choose between 
behaviours when a problem is "well defined". On the other hand, we know very 
little about how the process of obtaining "well defined problems" develops in 
spite of the fact that knowledge of the development of problem formulation pro- 
cesses is especially important in research aiming to find solutions to original 
problems which can be attacked by means of scientific methods. The problem 
defined must also contain clues pointing to the possibility of gaining new know- 
ledge. The researchers' ability to observe and to gain insight should be regard- 
ed as essential factors in the process of problem perception and problem defini- 
tion. It is namely in no way self-evident that ideas that are fruitful from a scien- 
tific point of view are included in the "official" lists of experienced problems that 
are sometimes compiled by consumers of behavioural research. Fruitful and con- 
vincing ideas are usually a result of continuous and tenacious intellectual work 
covering a period of years. 

2. 1 Development of a model for investigation 

Even though the purpose of an empirical investigation is to find patterns in a set 
of empirical data, the first step in carrying out such an investigation should be 
to discern important components which should be included in a model intended to 
reflect adequately the problem formulation process. 

In 1972 a pilot study was initiated to find indications of (1) how problem per- 
ception and definition together with the evaluation of problems develops as felt 
by behavioural scientists and (2) how the information search process influences 
the problem formulation process and vice versa. In this study we focussed our 
attention on the initial phase of the research process. This developmental pro- 
cess starts with the preparation of an outline of a research project and ends with 
the formal decision to give the outline project status and start developing a more 
detailed project design. Guided by the results of this study we developed a model 
on which we could base an interview study. In 1973, that investigation was carried 
out in order to collect a representative set of data about Swedish researchers' 
strategies of behaviour during the initial phase of a research process. The model 
which guided the investigation contains the following components: 

1. The researcher's motivation, i.e. his own aims and intentions. 

2. The researcher's perception of problems, i.e. generation of ideas, norms 
and values. 

3. The researcher's choice, transformation and structuring of problems and 
generation of hypotheses. 
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4. The researcher's choice of strategies concerning the search for information, 
the design and implementation of research plans. 

5. The researcher's choice of methods and techniques for information and docu- 
mentation of research results, design of investigations, collection and pro- 
cessing of data. 

6. The researcher's frame of reference, i.e. the extent to which the researcher 
identifies with a specialization, with a particular discipline, with an inter- 
disciplinary grouping or invisible colleges. 

7. Research organizations, both formal and informal within which researchers 
work. 

A detailed description and an attempt at quantification and systematic analysis of 
the model have been presented in B. Bierschenk (1974). An English summary of 
the main results is given in B. Bierschenk (1977 a). 

2. 2 Some methodological prerequisites 

The use of a given research strategy and certain special techniques for data col- 
lection, processing and analysis always implies a (hopefully) conscious choice. 
But it also means a focussing on or systematic search for new knowledge and a 
decision on methods, which aims at reducing as far as possible the influence of 
various conceivable sources of error. 

2. 2. 1 Researcher population and random sample 

The research results that will be presented below are based on forty randomly 
selected researchers out of a population of 126. The following criteria must be 
fulfilled for a person to be considered a researcher belonging to the population 
of investigation. A researcher is a person who (1) has studied at least one of the 
behavioural sciences (education, psychology, sociology) or statistics, (2) has 
taken at least a licentiate degree, (3) is connected with an on-going, recently 
started or completed project, seen from the perspective of 1972, (4) belongs to 
or is connected with at least one of the (then) eleven departments of educational 
and psychological research in Sweden, (5) is resident in Sweden and (6) has been 
included in one of the catalogues listing social science research of staff employed 
at the departments. These catalogues must have been published during the period 
1967-1972. Catalogues presenting developmental work are not counted. 

For a detailed description of the population and random sample and for an 
account of the data collection see B. Bierschenk (1974). 

2, 2. 2 Data collection and data analysi s 

If we assume that it is only individuals that can formulate problems of scientific 
interest, it becomes necessary to let individual persons express themselves free- 
ly. We chose to use an interview method for the collection of data. Our assump- 
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Box 1. Data processing and analysis 



Processing 

Models/techniques 



Analysis 

Models/techniques 



Description 
Inference 



Impressionistic 
content analysis 
Annerblom (1974) 



Computer. -based 
content analysis 
Bierschenk & 
Bierschenk (1976) 



Formalized state- 
ments together with 
assessment scales 
B. Bierschenk 
(1974 and 1977 a) 



Di chotomi zati on 
of attributes irre- 
spective of fre- 
quency 

Strict or rigid 
counting of fre- 
quencies with the 
purpose of apply- 
ing statistical 
models 

Index construction, 
Analysis of fre- 
quency distribu- 
tions by means of 
statistical models 



Descriptions with the 
purpose- of formulating 
hypotheses and discover- 
ing new unique attributes 

Objective, reliable and 

detailed description 
with the purpose of test- 
ing hypotheses. Apply- 
ing multivariate models 
for data analysis 

Descriptive and inference 
statistics. Description by 
means of m, s, r, F-ratio, 

2 



tion was that the researcher's chance to give free and unresticted answers would 

provide information of high validity, at least as long as we could assume that the 
researchers were seriously interested in participating in the study. But we also 
constructed an assessment schedule for the purpose of (i) getting the researchers' 
views on certain aspects in a formalized form, (2) getting the researchers' poss- 
ible suggestions for improvements and comments on wordings and statements in 
the schedule. The scheme for data processing and analysis is presented in Box 1. 

When the researcher demonstrate which aspects are to be mapped, he often 
constructs models and data matrices, in which the rows usually represent the 
measuring objects (in our case researchers). When using psychological tests or 
assessment scales, one gets scores that can be used directly for setting up data 
matrices. Such scores are not obtained immediately, however, when the basic 
material consists of verbal data. Thus it will be necessary to transform this type 
to numerical values. But the analytical problem in making inferences from ver- 
bal expressions is much the same as with all other types of raw data. We have to 
infer specific events, behaviours or characteristics which are associated with the 
objects of an investigation. 
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3. DEVELOPMENT OF A STRATEGY FOR THE ANALYSIS OF VERBAL DATA 

If we want to overcome successfully the difficulties that complex problems pose 
for researchers in the behavioural sciences, a great deal of openness is required 
and readiness to use new research strategies. But these should be precisely de- 
fined and explicitely described. 

The development of ideas, the formulation and solution of problems are be- 
haviours that are closely connected with man's specific ability to express him- 
self verbally. Attempts at exploring and studying not only problem -solving be- 
haviours but also the complex psychological process behind such behaviours are 
not confined to the field of psychology. For the past twenty years or so such ex- 
periments have also been carried out within several other branches of science, 
such as mathematics, artificial intelligence, information processing and quan- 
titative linguistics. The common factor of the research work done within the vari- 
ous disciplines is the goal of investigating and giving form to invisible symbolic 
processes and mechanisms. Instead of using simple mathematical formulas to 
try to describe such cognitive operations, researchers working in the fields 
named above are trying to develop computer programmes to describe them and 
to test models and theories on what complex psychological structures look like 
and how processes develop. 

These attempts at developing a theory on the content of the messages by 
means of which people communicate with each other aim at increasing our under- 
standing of the cognitive structures that are assumed to form the basis for a hu- 
man being's verbal expressions. By developing our assumptions step by step and 
continuously testing them, we try to determine their validity. The main question 
we have asked ourselves is the following; 

Can we by means of numerical analysis and quantitative description identify and 
categorize cognitive structures in pre -num. eric data, such as interview texts? 



3- 1 Development of a computer-based content analysis 

It is typical for written or spoken text that it is of great complexity and that the 
type of information to be extracted from the material is seldom or never collect- 
ed in one single place in the text. If structural relationships are to emerge all 
the same, the text must be prepared on the basis of certain assumptions. In 
Bierschenk & Bierschenk (1976) a flow chart is presented stating the individual 
steps in the development of the method for computer-based content analysis that 
we suggest. 

The chances of ready-developed methods being applicable often depend on the 
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appearance of the material. The attempts at analysis that have been described 
in the literature and that are of interest to our analysis have been developed with 
written text as a basis,, But since our material is spoken language text (tran- 
scribed 'from recording tape), which when uttered was meant for the ears of the 
interviewer alone, it became necessary' to build up our own system of rules and 
codes. A preliminary manual and some test results are presented in I. Bierschenk 
(19*74), but a new version will be published during 197?. 

The theories of verbal representation which we have found most interesting 
for our analysis are Schank's (1972) "Conceptual Dependency Theory" in connec- 
tion with ,{ Case Grammar 11 , In Bierschenk & Bierschenk (1976) we have shown 
how a model containing symbolic representations of concepts and conceptual re- 
lation can be applied to empirical materials. In our presentation two kinds of 
dependence and independence are distinguished: vertical relations,, i. e. between 
several independent concepts. We also discuss relations, i. e. the relation of 
clauses to each other. 

We take the theory of necessary parts into account in another way too. Since 
language is economical in relation to the thoughts behind the utterance, not all 
necessary parts are included in a speaker -listener situation. The necessary con- 
cept apparatus exists in the listener and a syntactically incomplete sentence is 
understood all the same. But the computer does not have this understanding, so 
therefore we supplement in the parts that are missing. It is our task to code com- 
plete complexes and complete Subject -verb -Object paradigms. Coding rules have 
been worked out and rules for the treatment of text for input in the computer have 
been specified. The way in which the feeding takes place, how identification is 
specified in the coding and the way in which we build tip our dictionary base are 
described in Bierschenk & Bierschenk (1976). 



3. 1. i Control of coder agreement 

By using the concept "Computer-based content analysis" we wish to point out that 
we do not intend to develop a method for automatic text analysis. At the same 
time this means that the basic material must first be coded before mechanical 
processings of various kinds can be carried out. The success with which two in- 
dependent coders have been able to apply different coding rules in a similar way 
is described in detail in Berg (1974). The intercoder agreement was examined 
with regard to (t) segmentation of concepts, (2) segmentation of clauses, (3) as- 
signment of codes to concepts and (4) assignment of codes to themes. All the 
comparisons are of the same type s i.e. either there is agreement or there is not. 
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The index values for these four steps vary for comparable text between i =. 82 
and i =. 98 (i: Osgood's index for agreement). More detailed information and test 
results obtained by applying the binomial test to the data may be found in Bier- 
schenk & Bierschenk (1976). 
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4. A PSYCHOLINGUISTIC PROCESS MODEL 



It is very difficult to try to map what is really meant in the research literature 
by content analysis, since each content analysis technique is based on a specific 
way of regarding the content in a message. A content analysis presupposes that 
we can define what is to be measured and counted in the analysis. 

In our discussion we have now reached the point where we have to introduce 
a psychological paradigm. We need a paradigm that takes into account not only 
representation of relations between concepts, but also goal-directed behaviour. 
The paradigm in our psycholinguistic model which serve this function is the well- 
-known Agent -action -Object (goal) paradigm. The central importance of the di- 
rected actitivy can be seen, among other things, by the function of the action in 
determining the nature of the AaO paradigm. 

4. 1 Psychological paradigm and unit of analysis 

The components of the AaO paradigm are briefly defined as follows: 

Agent. Centres of action or goal -seeking entities that make use of resources 
to reach their goals. This definition also includes groups, organiza- 
tions or abstractions that fill the function of being an agent. 

Action. A direct action that is carried out by an agent for the purpose of achiev- 
ing a goal. The action defines the content of the AaO paradigm. 

Object. Everything that an action can be directed at or implemented with. 

By means of the AaO paradigm, the components that form a natural content, 
i. e. an observable sentence, are isolated. By this is meant the fundamental form 
for a statement that is expressed by the noun, -verb-noun., relationship. The ana- 
lysis and synthesis of the psychological phenomena to be studied is constructed 
from this "whole observation sentence" (see Quine, 1972). 

4. 1. 1 Manifest level: Basic elements and syntax 

While agent and object (noun) are specified by attributes (adjectival phrases), the 
verb states the relation between the nouns, i.e. actions, events or state. The or- 
der of these basic elements is stated by means of syntax. By using empirically 
constructed "dictionaries" and a system of rules we hope to be able to construct 
theories and models that can be used to describe strategies of actions and events. 

4.1.2 Latent level: Cognitive structures 

Psychological research, and in particular its psycholinguistic branch, has long 
been trying to map the psychological processes underlying linguistic sentences. 
In explaining the acquisition of language the process theoreticians assume a cog- 
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nitive mechanism. Thus it is assumed that there are regularities in complex 
phenomena that can be observed or predicted. In our model we symbolize the in- 
dividual prerequisites of a researcher by means of theoretical constructs that are 
arranged around the Test-Operation-Test-Exit (TOTE) paradigm (see Miller, 
Galanter & Pribram, i960). TOTE symbolizes the many cyclical processes 
which are assumed to govern the organism's selection of information. In the same 
fashion we assume that TOTE at the cognitive level governs the choices and de- 
cisions necessary for the development of a research process. 

Problem formulation and problem solving are fundamental human operations. 
But since science cannot be regarded as a determinable object or a determinable 
set of problems, but must be considered as a way of attacking problems (methods 
and goals), everything can be changed into an object for scientific examination. 

Thus in the model method is defined as the process of a systematic search 
for new knowledge. This process is made explicit by research designs or designs 
for a systematic information search. In the model, goal is defined as the focus- 
ing of attention on the objectives of a piece of research. Plans are made concrete 
by the research strategies established. By strategy is meant a sequential or hier- 
archical order or a set of instructions which steers the actions of an organism 
according to a plan, i. e. the performance. Transferred to the problem of search- 
ing for scientific information, that means the use of such advanced systems as 
computer-based I&D systems. Thus in the model it is the method that defines the 
content in the Problem -Method-Goal (PMG) paradigm. 

On the latent level it is (1) generally available knowledge (evidence) and (2) 
anticipated problem solutions (plans and strategies) that form indispensable ele- 
ments in the research process. 

4. 1. 3 Inference: Reconstruction of reality 

In our psychological model, the operationalizing and interpreting functions are 
summarized under the term "concept". It is assumed that every utterance is 
based on concepts that form the basis for key words in a clause. We hope that in 
describing the research process the concepts will reflect (1) the researcher's mo- 
tives and (2) frame of reference, which are assumed to steer his (3) formulation 
of hypotheses and (4) development of designs, (5) choice of methods and (6) tech- 
niques or instruments necessary for the accomplishment of a scientific task. 



4. 2 Operationalization of the psycholinguistic process model 

The building up of concepts in a given context presupposes a system of rules that 
state how and in what order different elements are to be linked together. We as- 
sume, for example, that the relations that exist between nouns and adjectives and 
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between nouns and verb represent the same relations as those between empirical 
phenomena. If, for example, we want to state that a set of nouns is modified by 
a set of adjectives we can formalize this relationship. 

The usual way of stating a relation is to specify a rule that says what are to 
be regarded as elements, pairs etc. If, for example, we wish to state for our 
sample space {$ ) that A is the set of all nouns and B is the set of all adjectives 
modifying A, this relation can be stated more formally in the following way: 

_P = | (a,b) e* A x B | a modified by b j . 

Further, we assume that nouns get part of their empirically specified content 
through adjectives and verbs to which they are linked. By scaling adjectives and 
verbs we can acquire numeric descriptions and quantitative analyses of text. 
When we have in this way observed similarities or co-variations and defined dif- 
ferent properties, we can carry out multivariate analyses in order to determine 
the position of a particular property in a number of latent dimensions. 

It should also be mentioned that work is under way to find out how we might 
quantify the "stretching property" of adverbs (see Cliff, 1969, p 144). The 
measurement suggested by I. Bierschenk (1977) implies that we eventually may 
be able to describe the whole vertical relationship, i.e. between dependent and 
independent concepts. 



^' 2- i Scaling of adjectives and verbs 

Researchers have usually used semantic differentials linked to adjectives when 
describing an object. We consider that the boundaries between adjectives and 
verbs are vague and that in principle all "dependent" concepts should be utilized 
in the description of a. phenomenon (see Ross, 1969). Since in our analysis we 
take into consideration "syntactic behaviour" and regard both adjectives and 
verbs as descriptive concepts, we have decided to scale them. An adjective de- 
scribes a noun directly, while the verb has the same function more indirectly. 
The scaling was carried out by means of seven-point assessment scales, the bi- 
polar end-points of which are described as pairs of adjectives (1) positive -nega- 
tive, (2) active -passive and (3) strong -weak. A detailed account of this is to be 
found in Bierschenk & Bierschenk (1976). 

Panel assessment is the method of approach which was used to produce as- 
sessment values for all the adjectives (n = 570) and verbs (n = 883) extracted in 
the dimension concerned (8 718 assessments). The random sample of 15 persons 
included in the assessment panel is covered by our definition of "researcher", 
which should make it possible to generalize the results. 

In order to avoid, among other errors of measurement, some concepts being 
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liable to a fatigue effect, the order of the words has for each individual assessor 
been determined at random, i.e. 15 different random orders of sequence were 
generated by the computer. In addition the three dimensions have been separated 
in order to counteract any mixing of the individual scales. This means that each 
person received six different random orders of sequence. The assessment panel 
made its assessments during the spring term of 1975. 

Since we shall be making use of the mean assessment of the assessors and 
all adjectives and verbs respectively that define a particular noun, we have not 
only estimated intraclass correlations but also the structure of the assessment 
(see Guilford, 1954, pp 253-254). In order to obtain a coefficient for maximal 
reliability for the respective scales, each position. on the seven-point scale has 
been weighted according to the component analysis. The coefficient for maximal 
reliability was introduced by Lord (1958). This coefficient is a simple function of 
the largest characteristic root of correlation matrix for the variables forming 
the scale. A detailed account of our results in the reliability studies carried out 
is presented in Bierschenk & Bierschenk (1976), In Table i, therefore, only the 
most condensed reliability estimations will be given. 



Table 1. Reliability in the assessments of adjectives and verbs (« ) 











Object of 
assessments 


Dimension 
(i) Evaluation 


(2) Activity 


(3) Power 


Adjective 
Verb 


.91 
.95 


.92 

,93 


.88 
. 86 

, ,. ■ ii mini ii mi if 



In order to create a weighted summation variable, the weights are used from the 
first unrotated component. Each assessment is multiplied by the weight for the 
respective assessor and dimension. Then the sums of these products were calcu- 
lated. In order to create weighted means for each adjective and verb, the totals 
have been divided by the sum of the weights. If any assessment has been dropped, 
the corresponding weight has been subtracted when the sum of the weights was 
calculated. 



4. 2. 2 Generation of concepts 

In the behavioural sciences text analyses are usually based either on an examin- 
ation of the text, looking for specific key concepts, or on the frequency of a spe- 
cific concept in the text. The application of a concept system in the coding of texts 
assumes that the latent structure of the text is reflected in the concepts and in 
the structure represented by a system of categories. A content analysis based on 
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dicho tortious decisions about or frequency distribution of concepts can, however, 
prove to be insensitive to the researcher's own terminology and way of structuring 
text. 

Treatment of researchers' verbal statements by ANACONDA involves an ana- 
lysis and synthesis of both empirical statements and the relationships between 
them. This means that we cannot be content with a traditional lexico-graphic list- 
ing of words as a base for an approximation of the researcher's implicit models 
for the research process, but have to build up dictionaries empirically. At the 
same time it also means that we must be able to handle large amounts of data so 
that meaningful statistical descriptions and analyses become possible. The way 
in which we have carried through the task is mapped by the following 15 step ana- 
lysis programme: 

Step 1: An analysis of how many agents the 40 researchers have produced in 
four questions out of 51. 

Step 2: An analysis of how the agents are distributed over the researchers. 

Step 3: An analysis of how many objects the 40 researchers have produced in 
four questions out of 51. 

Step 4: An analysis of how the objects are distributed over the researchers. 

Step 5: A cluster analysis of the agents: (1) BMD P01M, in which the agents 
are treated as variables and (IJ BMD P02M, in which the agents are 
treated as measuring objects (Dixon, 1975). 

Step 6: A cluster analysis of the objects: (1) BMD P01M, in which the objects 
are treated as variables and (TTbMD P02M, in which the objects are 

treated as measuring objects. 

Step 7: A cluster analysis of blocks: BMD P03M, in which agents and objects 
respectively form one block and the researchers another and where 
the threshold values (step lengths) are placed at . 20 and . 10 respect- 
ively. 

Step 8: An analysis of the agents' coincidences with objects, where the coin- 
cidences are determined through verbs 

Step 9: An analysis of the number of agents that occur at least five times in 
the interview material . 

Step 10: An analysis of the number of objects that occur at least five times in 
the interview material. 

Step 11: An analysis of the distribution of the number of agents that coincide 
with such objects as occur at least five times. 

Step 12: An analysis of distribution of the number of objects that coincide with 
such agents as occur at least five times. 

Step 13: A cluster analysis of agents and objects respectively: BMD P01M, in 
which (i) agents and (2) objedts are treated as variables. 

Step 14: An analysis of the agent clusters' coincidence with the object clusters, 
where the coincidences are determined by verbs. 

Step 15: A discriminant analysis -of reduced coincidence matrices: The computer 
programmes used are MA.NOVA & DISCRIM and the programme from 
SPSS (Nie et al. , 1975). 
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5. RECONSTRUCTION OF REALITY: MAIN RESULTS FROM AN ANALYSIS OF 
DISCRIMINATION 

The relations that are assumed to exist between concepts are implicative or in- 
ferential and they are intended to be ope rationalized by means of analysis models 
based on perceived co -variations or correlations. In order to be able to study 
the dimensionality in the researchers' verbal statements, we have applied the 
discriminant analysis model. A summary of the main results will now be given. 
More detailed information and a discussion of how the prerequisites of the model 
have been fulfilled may be found in B. Bierschenk (1977 b). 

The assessment scores describing the interview material have been arranged 
in accordance with the following scheme of co-variation: 

G: Scales 1(1)3; A: Agents 1(1)14; C: Concepts 1(1)6. 

Working with the complete AaO relation, we have defined the derived "clusters 
of agent" as measuring objects and the "clusters of concept" as. variables. These 
together with the scales form three groups for assessment. The purpose of this 
co -variation scheme is to study the linear combinations that must be formed if 
the variance between the scales is to be maximized. A discriminant analysis of 
this type means that we study the co-variance between the scales. In this analysis 
we study the importance of objects and scales for a particular agent. 

When three groups exist, two discriminant functions can be formed. The dis- 
criminating power and test statistics are given in Table 2 together with the stan- 
dardized functions. 

Table 2. Discriminating power of discriminant functions and 
standardized discriminant function coefficients for 
concept clusters 



X. Eigen value 

% Relative percentage 

of total variance 
R Canonical correlation 
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df p 
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1.36 75.85 
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.43 24.15 


.55 
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c reference 
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3. Discussion of problems 








.44 


.82 


4. Channnels of information 








.53 


-.71 


5. Information 


on research me 
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-.17 


-.49 


6. Information 


on demarcation 


of concepts 




. 32 


. 33 



A Wilk's lambda 

X Chi square 

df Degrees of freedom 

p Level of significance 
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As can be seen from Table 2, the first function is much more important for the 
separation than the other. But both are successful in separating our three scales. 
The standardized coefficients reproduced in Table 2 can be interpreted in the 
same way as factor loadings or beta weights in a multiple regression analysis. 
In this sense the coefficients state which clusters contribute most to differenti- 
ation in the respective dimension. 

The clusters that are important for the first function are "Bibliografic refer- 
ences" and "Channels of information" which in addition show high negative weight 
in the second function. 

The ones that are important for the second function are "Discussion of prob- 
lems" and with a negative sign "Information on research methods". "Information 
on demarcation of concepts", on the other hand, is of little importance for both 
functions. This result is in perfect agreement with the results presented in B. 
Bierschenk (1974). The omitted second concept cluster "Research organization" 
has no discriminating power, but rather a reducing effect when the cluster is 
combined with the others. 

A summary of how far we have succeeded in separating the scales and the 
extent to which the classification of the individual agent clusters has been achiev- 
ed is shown graphically by the two-dimensional discrimination space in Figure i. 
The centroids (* ) in Figure 1 state the mean value of the discriminant scores 
for each scale and respective function. As can be seen from Figure 1, Function 
1 discriminated well between "Evaluation" (1) and "Power" (3). Function 2 is 
needed to distinguish as far as possible "Activity" (2) from "Power" (3). Figure 
1 shows that it is easier to differentiate between evaluation and power than be- 
tween evaluation and activity, or power and activity. But the separation of func- 
tion 2 would probably emerge even more clearly if it were not for three outliers. 

The agent cluster "Dissemination of information" with the discriminant scores 
(1, 63, -1. 61) in the e\'aluation dimension and (-1. 67, -2. 60) in the activity dimen- 
sion is the one that deviates markedly from the other clusters. The other agent 
cluster that falls outside its group affiliation is "Methodological problems" with 
the discriminant scores (1.15, 2. 00) in the activity dimension 

These circumstances can be studied in more detail by examining the linkages 
of agent clusters with regard to the values presented in Table 3. 

The agent cluster "Dissemination of information" that includes the agents 
"Literature" and "Symposium" (see B. Bierschenk, 1977 b, Box 1) will be used 
to give an example of such an examination. If "Dissemination of information" is 
related to "Bibliographic reference" (that encompasses the concepts "Literature", 
"Reference" and "Journal") via the verb linkages, it proves that the actions ex- 
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Figure 1. Plot of discriminant score 1 (horizontal) vs. discriminant score 2 (vertical). * Indicates a group centroid. 



Table 3. Mean values and standard deviations for 14 agent clusters, 
6 concept clusters and 3 assessment dimensions 
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Agent Clusters 

1 Social -psychologically oriented researchers 

2 Pupil -oriented researchers 

3 Language -oriented researchers 

4 Science -oriented researchers 

5 Cognition -psychology- oriented researchers 

6 Researchers interested in methodological 
problems 

7 Researchers interested in programmes for 
applying influence 



8 Linguistically-oriented researchers 

9 Humanistically-oriented researchers 
10 Researchers interested in sosialization 
li Dissemination of information 

12 Type of information and transference 
of information 

13 We 

14 Person 



Dimensions 

1 positive/negative 

2 active/passive 

3 strong/weak 



oo 
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press a weak positive evaluation (m = 4. 59), passivity (m = 3„ 21} and weak 
power (m - 3. 32). 

The second relation to be studied is between "Channel of information" (in- 
cluding e.g. "Library" and "Psychological Abstracts") and "Bibliographic refer- 
ence", which expresses much the same evaluation (m = 4, 60) but higher activity 
(m = 4. 21} though with weak power (m - 3, 76). 

The third relation of interest is between "Channel of information" and "Prob- 
lem discussion" (containing the concepts "Discussion" and "Problem"). The ac- 
tions expressed by the verb show a negative evaluation (m = 3.46), passivity 
(m = 2. 39 and weak power (m = 3. 75). 

The fourth relation to be investigated is between "Dissemination of inform* 
ation" and "Information on Research Methods" (including e.g. "Design" and 
"Measurement"). The relating verbs express actions that are somewhat more 
positive (m = 4. 06) in their evaluation. They are also somewhat more active 
(m = 4. 11) and show a marginal increase in power (m = 3. 88). 

Against the background of these results, the following conclusions can be 
drawn. The dissemination of information by means of literature and symposia do 
not contribute noticeably to problem discussion. Moreover this agrees entirely 
with our expectation that the activities connected with symposia do not express 
much dynamic, i.e. activity and power. Since this is the case, the actions should 
not express any very great positive evaluation either. The actions that associate 
dissemination of information via literature and symposia with information on re- 
search methods are rather neutral in all three dimensions. But it is also plain 
that information on research methods is to a somewhat greater extent sought and 
disseminated via literature and symposia than information that is of importance 
for problem discussions. This result coincides perfectly with the researchers' 
statement that they want a change, towards a greater depth in. research methods 
as reported in B. Bierschenk (1977 a). 



20 - 



VALIDITY OF ESTABLISHED STRUCTURES 



Instead of the "Discussion" or "Summary" usually closing a presentation, we 
wish to conclude our account of methodological developments by trying to demon- 
strate the validity of the results we have arrived at with ANACONDA. 

The researchers' answers to questions concerning information and documen- 
tation have been systematized by Annerblom (1974) in the form of an impression- 
istic content analysis. This analysis and the evaluation on seven-point bipolar 
scales presented in Bierschenk (1974, 1977 a) will be used to demonstrate the 
validity of the ANACONDA -method. 

The results show that a thorough and systematic check of research publica- 
tions is the exception rather than the rule. Personal contacts are felt to be the 
best source of information, but do not appear to play an important part in the re- 
searcher's attempts to bring about a mutual exchange of information. The library 
is in many cases used because of good personal relations with the library staff. 
But the expectations of obtaining information from libraries are low, however. 
It emerges from the comments on the evaluation of reference organs that the re- 
searchers feel dissatisfied with their quality and wish for improvements. Sym- 
posia are attended roughly once a year. The information obtained from reference 
organs and symposia is evaluated lowest. The methods used in searching for re- 
ferences to literature are unsystematic and are employed periodically. 

The researchers do not appear to search for information on research methods 
while the problem discussion is underway or when information for the demarca- 
tion of concepts is sought. This result is also supported by all the critical opinr 
ions on printed information material. Nor is information on research methods 
that is available in handbooks and works of reference sought to any great extent, 
instead such information is sought mainly from tutors and fellow-researchers. 

The impression given by this account and the conclusion reaches in connection 
with the outcome of the discriminant analysis are utilized in Box 2 to make ex- 
plicit how researchers perceive information problems and which strategies they 
implement to reach the scientific information needed for a successful definition 
of research problems. 

The result pictured in Box 2 represent a stereotyped account and therefore 
need some illumination: The researcher seeks information for demarcation of 
concepts mainly via problem discussions. Information on research methods, on 
the other hand, is sought neither by the use of different channels of information 
nor through problem discussion. Information for demarcation of concepts seems 
to be a particular type since it is negatively related to information on research 
methods. But the evaluations, the activity and the power that the actions express 
show neutral to negative attitudes. 






Box 2. Search for scientific information 



Strategy 


( t ) demarcation 
of problems 


(2) information on 
research problem 


Problem 
discussion 
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■p 


Bibliographic 
reference systems 


+ 





Consultation of 
tutors, fellow re- 
searchers and sym- 




+ 


posiums 







+ strategy is used 

- strategy is not used 

strategy is used occasionally 
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Bierschenk, B. A new approach to psychometric problems in the 
analysis of pre -numeric data. Didakometry (Malmo, Sweden: 
School of Education), No. 55, 1977. 

This report suggests anew approach to quantification of the 
relations within a whole sentence and presents a system for 
the analysis of concepts by data processing (ANACONDA). 
The psychological model for ANACONDA is outlined. Panel 
assessments have been used for quantification. On the basis 
of the results obtained, relation patterns have been studied 
by means of a discriminant analysis. An attempt has been 
made to demonstrate the validity of the methodological ap- 
proach used. 

Keywords: Psycholingui sties, concept formation, cognition, 
interview data, psychometrics, information and documenta- 
tion, regression analysis. 
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